Interval estimation

In statistics, interval estimation is the use of sample data to calculate an interval of possible (or probable) values of an unknown population parameter, in contrast to point estimation, which is a single number. Neyman (1937) identified interval estimation ("estimation by interval") as distinct from point estimation ("estimation by unique estimate"). In doing so, he recognised that then-recent work quoting results in the form of an estimate plus-or-minus a standard deviation indicated that interval estimation was actually the problem statisticians really had in mind.

The most prevalent forms of interval estimation are:

• confidence intervals (a frequentist method); and
• credible intervals (a Bayesian method).

Other common approaches to interval estimation, which are encompassed by statistical theory, are:

• Tolerance intervals
• Prediction intervals - used mainly in Regression Analysis
• Likelihood intervals

There is a third approach to statistical inference, namely fiducial inference, that also considers interval estimation. Non-statistical methods that can lead to interval estimates include fuzzy logic.

An interval estimate is one type of outcome of a statistical analysis. Some other types of outcome are point estimates and decisions.

Contents 1 Discussion 2 See also 3 References 4 Bibliography

Discussion

The scientific problems associated with interval estimation may be summarised as follows:

• When interval estimates are reported, they should have a commonly-held interpretation in the scientific community and more widely. In this regard, credible intervals are held to be most readily understood by the general public. Interval estimates derived from fuzzy logic have much more application-specific meanings.
• For commonly occurring situations there should be sets of standard procedures that can be used, subject to the checking and validity of any required assumptions. This applies for both confidence intervals and credible intervals.
• For more novel situations there should be guidance on how interval estimates can be formulated. In this regard confidence intervals and credible intervals have a similar standing but there are differences:

• credible intervals can readily deal with prior information, while confidence intervals cannot.
• confidence intervals are more flexible and can be used practically in more situations than credible intervals: one area where credible intervals suffer in comparison is in dealing with non-parametric models (see non-parametric statistics).

• There should be ways of testing the performance of interval estimation procedures. This arises because many such procedures involve approximations of various kinds and there is a need to check that the actual performance of a procedure is close to what is claimed. The use of stochastic simulations makes this is straightforward in the case of confidence intervals, but it is somewhat more problematic for credible intervals where prior information needs to taken properly into account. Checking of credible intervals can be done for situations representing no-prior-information but the check involves checking the long-run frequency properties of the procedures.

Severini (1991) discusses conditions under which credible intervals and confidence intervals will produce similar results, and also discusses both the coverage probabilities of credible intervals and the posterior probabilities associated with confidence intervals.

See also

The Behrens–Fisher problem. This has played an important role in the development of the theory behind applicable statistical methodologies. This problem is one of the simplest to state but which is not easily solved. The task of specifying interval estimates for this problem is one where a frequentist approach fails to provide an exact solution, although some approximations are available. The Bayesian approach also fails to provide an answer that can be expressed as straightforward simple formulae, but modern computational methods of Bayesian analysis do allow essentially exact solutions to be found. Thus study of the problem can be used to elucidate the differences between the frequentist and Bayesian approaches to interval estimation.

References

• Neyman, J. (1937) "Outline of a Theory of Statistical Estimation Based on the Classical Theory of Probability" Philosophical Transactions of the Royal Society of London A, 236, 333–380.
• Severini, T.A. (1991) "On the relationship between Bayesian and Non-Bayesian interval estimates" Journal of the Royal Statistical Society, Series B, 53 (3), 611–618

Bibliography

• Kendall, M.G. and Stuart, A. (1973). The Advanced Theory of Statistics. Vol 2: Inference and Relationship (3rd Edition). Griffin, London.

In the above Chapter 20 covers confidence intervals, while Chapter 21 covers fiducial intervals and Bayesian intervals and has discussion comparing the three approaches. Note that this work predates modern computationally intensive methodologies. In addition, Chapter 21 discusses the Behrens–Fisher problem.

Statistics   Descriptive statistics Continuous data Location Mean (Arithmetic, Geometric, Harmonic) Median Mode Dispersion Range Standard deviation Coefficient of variation Percentile Interquartile range Shape Variance Skewness Kurtosis Moments L-moments Count data Index of dispersion Summary tables Grouped data Frequency distribution Contingency table Dependence Pearson product-moment correlation Rank correlation (Spearman's rho, Kendall's tau) Partial correlation Scatter plot Statistical graphics Bar chart Biplot Box plot Control chart Correlogram Forest plot Histogram Q-Q plot Run chart Scatter plot Stemplot Radar chart   Data collection Designing studies Effect size Standard error Statistical power Sample size determination Survey methodology Sampling Stratified sampling Opinion poll Questionnaire Controlled experiment Design of experiments Randomized experiment Random assignment Replication Blocking Factorial experiment Optimal design Uncontrolled studies Natural experiment Quasi-experiment Observational study   Statistical inference Statistical theory Sampling distribution Sufficient statistic Meta-analysis Bayesian inference Bayesian probability Prior Posterior Credible interval Bayes factor Bayesian estimator Maximum posterior estimator Frequentist inference Confidence interval Hypothesis testing Likelihood-ratio Specific tests Z-test (normal) Student's t-test F-test Pearson's chi-squared test Wald test Mann–Whitney U Shapiro–Wilk Signed-rank Kolmogorov–Smirnov test General estimation Bias Robustness Efficiency Maximum likelihood Method of moments Minimum distance Density estimation   Correlation and regression analysis Correlation Pearson product-moment correlation Partial correlation Confounding variable Coefficient of determination Regression analysis Errors and residuals Regression model validation Mixed effects models Simultaneous equations models Linear regression Simple linear regression Ordinary least squares General linear model Bayesian regression Non-standard predictors Nonlinear regression Nonparametric Semiparametric Isotonic Robust Generalized linear model Exponential families Logistic (Bernoulli) Binomial Poisson Partition of variance Analysis of variance (ANOVA) Analysis of covariance Multivariate ANOVA Degrees of freedom   Categorical, multivariate, time-series, or survival analysis Categorical data Cohen's kappa Contingency table Graphical model Log-linear model McNemar's test Multivariate statistics Multivariate regression Principal components Factor analysis Cluster analysis Copulas Time series analysis Decomposition (Trend, Stationary process) ARMA model ARIMA model Vector autoregression Spectral density estimation Survival analysis Survival function Kaplan–Meier Logrank test Failure rate Proportional hazards models Accelerated failure time model   Applications Biostatistics Bioinformatics Biometrics Clinical trials & studies Epidemiology Medical statistics Engineering statistics Chemometrics Methods engineering Probabilistic design Process & Quality control Reliability System identification Social statistics Actuarial science Census Crime statistics Demography Econometrics National accounts Official statistics Population Psychometrics Spatial statistics Cartography Environmental statistics Geographic information system Geostatistics Kriging Category Portal Outline Index